Overview of analyses
Risk of Bias (RoB)
Risk of bias was evaluated across predefined methodological domains and summarized at both the domain and study levels. Distributions of low, unclear, and high risk ratings are presented using summary bar plots, while individual study judgments are visualized with traffic-light plots.
Inter-rater reliability
Inter-rater reliability was assessed using observed agreement, Cohen’s kappa, and prevalence-adjusted bias-adjusted kappa (PABAK). Agreement patterns are further examined using confusion matrices, heatmaps, and domain-specific reliability estimates to identify areas of consistent and inconsistent interpretation.
Risk of Bias (RoB)
Summary bar plot
Risk of bias summary across domains. Bars show proportions of Low, Unclear, and High scores.
Interpretation. Domains with a higher proportion of Low judgments suggest stronger methodological rigor. Domains dominated by Unclear or High indicate potential limitations (e.g., insufficient reporting or methodological concerns). Overall summarizes study-level risk of bias.
Traffic-light plots
Traffic-light plots show risk-of-bias judgments by study and
domain.
Green indicates low risk of bias, yellow indicates unclear risk, and red
indicates high risk of bias.